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DETAILED ACTION 
Claim Objections 

1 . Claim 10 is objected to because of the following informalities: 

Re claim 10, line 5 should be "an" obstacles instead of "n". 
Appropriate correction is required. 



Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1, 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 

3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

3. Claims 1-2 , 4-13 are rejected under 35 U.S.C. 103(a) as being unpatentable 

over Ponsot et al., US- 6, 606,538 in view of Konolige et al., US 2005/01 00207A1 and 
further in view of Fair et al., Automated Staircase Detection, Alignment & Traversal. 

Re claim 1, Ponsot teaches a monitoring system (figs. 1-2) for the detection a 
person or object within a detection zone of an escalator (col. 3, lines 42-56) comprising 
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at least one video camera (5-9) and at least one escalator and/or moving walk (1) for 
acquiring a plurality of images. Since Ponsot discloses the detection of persons or 
objects from in a detection zone, it would be inherent to segment the images into an 
escalator background and an obstacles and persons foreground; which is evident by 
Ponsot disclosing detecting the presence of persons or objects in a detecting zone 
(column 1 line 58-66). The cameras 5 to 9 are connected to a monitoring device 10 to 
which they transmit video images of the respective zones they cover. The monitoring 
device is designed to respond to the images transmitted by the cameras 5 to 9 to 
determine whether an object or person is to be found in the detection zone (column 3 
line 50-56). Ponsot is silent in regards to a model based staircase pose estimator, 
acquires stereoscopic images; and determines differences in a rectified stereo images 
pair which are segmented into an escalator background and an obstacles and persons 
foreground. However, Ponsot fails to teach acquiring stereoscopic images as claimed 
and determining the differences in rectified stereo image pair. It is noted that the system 
and process for acquiring stereoscopic images is notoriously well known and used in 
the art for depth perception to enhance image detection as evidence by Konolige. 
Konolige discloses the two images to be correlated may come either from two different 
cameras separated spatially that capture images at the same time ([0002], [0014], 
[0015], [0017], [0058], [0059], and fig. 1). Konolige discloses a disparity map calculator 
connected to the output of the stereo correlation means, for calculating a disparity map 
of the object scene ([0019]). It should be noted that disparity is the difference of two 
images that have been positioned or overlaid on top of one another in stereoscopic or 
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stereovision. Further disclosed are Laplacian image pyramids are built and disparity 
maps are produced ([0018]). One aspect of the pyramid method is progressive 
compression, which the decoder inputs the compressed stream section by section, and 
each section improves the appearance of the image; which would also rectify the image. 
The examiner takes the position that rectification is just the adjustment of images to 
simplify stereoscopic images. Konolige also discloses the use of rectification for 
images that due to lighting biases that differ between the images, distortions introduced 
by the lenses, and image plane geometry. Compensation for geometric distortion is 
possible by rectifying the original images, by mapping the original image into a warped 
image ([0078]). Also, Konolige discloses the use of sub-pixel mapping between the 
rectified and original image ([0086] and [0087]). The examiner takes the position that in 
order for the method as disclosed by Konolige to compute sub-pixel mapping between 
the rectified image and the original image, it would necessitate the comparing and 
determining the differences of the rectified image. 

However, the combination of Ponsot and Konolige are silent in regards to a 
model based staircase pose estimator. However, Fair discloses a technique for 
detecting the top and bottom of a staircase to allow automated descents and ascents of 
staircases (see introduction) as well as stair negotiation. It is clear to the examiner that 
since Fair discloses a technique for detecting the top and bottom of a staircase as well 
as stair negotiations, it is would necessitate the use of model based staircase pose 
estimation. 
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Therefore, it would have been obvious to one of ordinary skill in the art at the 
time of the invention to combine the teachings of Ponsot and Konolige with the 
teachings of Miller for providing position and orientation of objects or persons within the 
detection zone as wells a providing a more intelligent and robust layer of control that 
can plan ahead, bringing safety and efficient to the task of climbing stairs (see 
introduction). 

Re claim 2, the combination of Ponsot, Konolige and Fair as a whole teaches 
everything as claimed above, see claim 1 . In addition, Ponsot further teaches the 
video cameras are located above the escalator and/or moving walk (Ponsot, fig. 1). 

Re claim 4, the combination of Ponsot, Konolige, and Fair teaches everything as 
claimed above, see claim 1. In addition, Ponsot further teaches more than one pair of 
video cameras are arranged along the escalator (moving staircase) and/or moving walk 
to monitor a full length (entire detection zone which includes all of the moving staircase) 
of the escalator and/or moving walk (Ponsot col. 3 line 44-49 also fig. 1). 

Re claim 5, the analysis and rejection for claim 1 also apply here. Specially, 
Ponsot fails to further teach a processing unit for processing the stereoscopic images. 
However, Ponsot does teach the monitoring system comprising a processing unit for 
processing a plurality of images and acquiring images on a moving escalator (column 3 
lines 42-56 and fig. 1). Konolige discloses acquiring stereoscopic images (stereo vision, 
[0004], [0005], 0014], [0015] and fig. 1), and a signal processing unit (fast DSP 
processor, [0033] and 84) for processing stereoscopic images. 
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Therefore, the combined teaching of Ponsot and Konolige as a whole would 
have rendered obvious to one of ordinary skill in the art at the time the invention was 
made to acquiring and signal processing stereoscopic from the plurality of images as 
claimed for the benefit of depth perception to enhance image detection as taught by 
Konolige. 

Re claim 6, the combination of Ponsot, Konolige and Fair teach everything as 
claimed above, see claim 5. In addition, Ponsot further teaches the monitoring system 
further comprises a data exchange bus for linking the video cameras with the 
processing unit (column 4 line 17-30, fig. 2: 14, 15) and means for storing the 
stereoscopic images (Ponsot, column 4 line 1-6, 21-24 and fig. 3). 

Re claim 8, the combination of Ponsot, Konolige and Fair as a whole further 
teaches everything as claimed above, see claim 5. Further, Ponsot further teaches the 
processing unit is integrated with at least one camera (Ponsot, col. 8 line 52-56 and fig. 
2). 

Re claim 9, the combination of Ponsot, Konolige and Fair as a whole further 
teaches everything as claimed above, see claim 5. Further, Ponsot further teaches the 
monitoring system is connected electrical to a control for restarting the escalator and/or 
moving walk after a stop only when no obstacle and/or person is detected on the 
escalator and/or moving walk (Ponsot, col. 2 line 19-23, col. 3 line 56-52, and col. 9 line 
3-6, i.e. switching the unavailability of failure signal of the monitoring device). 

Re claims 10-11, the analysis and rejection made in claims 1-9 also apply here. 
The combination of Ponsot and Konolige as a whole teaches a processor-based 
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system. Hence, a computer program product for executing the necessary steps 
corresponding to the system of claim 1 would have been inherent. 

Re claims 12-13, which recite a corresponding method to the monitoring system 
of claims 1-9. Thus, the analysis and rejection made in claims 1-9 also apply here 
because the monitoring system in claims 1-9 would have necessarily performed the 
method steps in claim 12. 

In further regards to claim 13, the combination of Ponsot and Konolige teaches 
restarting the escalator and/or moving walk automatically (Ponsot, col. 4 line 9-16; in 
Ponsot, the main function of the processor is to receive the images coming from the 
cameras, to process the images in order to determine whether or not persons or objects 
are present in the detection zone and as a function of the presence or absence of 
persons or objects in the detection zone to generate command signals for controlling 
the staircase, which signals are to be applied to the control device after a stop only 
when no obstacle and/or person is detected on the escalator and/or moving walk). 

4. Claim 3 is rejected under 35 U.S.C 103(a) as being unpatenable over Ponsot et 
al., US-6, 606,538 in view of Konolige et al., US-2005/0100207A1 and further in view of 
Fair as applied to claim 1 above and further in view of Ahl et al., US-5, 704, 464. 

Re claim 3, the combination of Ponsot and Konolige fails to teach the monitoring 
system characterized in that the video cameras are located in a balustrade of the 
escalator and/or moving walk. Ahls discloses a passenger sensor (fig. 2:32) for a 
convey or includes a transmitter assembly that is positioned within a channel in the 
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conveyor or balustrade (fig 2:22). Therefore, the combined teachings of Ponsot, 
Konolige and Ahls et al, as a whole would have rendered obvious to one of ordinary skill 
in the art at the time the invention was made to modify the arrangement of using a 
monitoring system located in the balustrade as claimed for the benefit to determine the 
presence of a passenger. 

Continued Examination Under 37 CFR 1.114 

1. A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1 .17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1.17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.1 14. Applicant's submission filed on 
1 1/13/2007 has been entered. 

Examiner's Note 

The referenced citations made in the rejection(s) above are intended to 
exemplify areas in the prior art document(s) in which the examiner believed are the 
most relevant to the claimed subject matter. However, it is incumbent upon the 
applicant to analyze the prior art document(s) in its/their entirety since other areas of the 
document(s) may be relied upon at a later time to substantiate examiner's rationale of 
record. A prior art reference must be considered in its entirety, i.e., as a whole, 
including portions that would lead away from the claimed invention. W.L Gore & 
associates. Inc. v. Garlock. Inc. , 721 F.2d 1540, 220 USPQ 303 (Fed. Cir. 1983), cert. 
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denied, 469 U.S. 851 (1984). However, "the prior art's mere disclosure of more than 
one alternative does not constitute a teaching away from any of these alternatives 
because such disclosure does not criticize, discredit, or otherwise discourage the 
solution claimed...." In re Fulton , 391 F.3d 1195, 1201,73 USPQ2d1141, 1146 (Fed. 
Cir. 2004). 

Conclusion 

2. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

3. Nichani et al., US- 2004/0045339A1 Stereo Door Sensor 

4. Lee at al., US- 7, 1 1 3,632 Method of and apparatus for rectifying a stereoscopic 
image 

5. Kagita et al., US-6, 466,255 Stereoscopic video display method and apparatus, 
stereoscopic video system, and stereoscopic video forming method 

6. Hsu, et al., Pose Estimation, Model Refinement, and Enhanced Visualization 
Using Video 

7. Sato et al., US- 6, 157, 337 3D image acquiring and viewing systems and 
methods 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jessica Roberts whose telephone number is (571) 270- 
1821. The examiner can normally be reached on 7:30-5:00 EST Monday-Friday, Alt 
Friday off. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha D. Banks-Harold can be reached on (571) 272-7905. The fax 
phone number for the organization where this application or proceeding is assigned is 
571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

MARSHA D. BANKS-HAROLD 
SUPERVISORY PATENT EXAMINER 
/Jessica M. Roberts/ TECHNOLOGY CENTER 2600 



